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Abstract 

Boltzmann's entropy is slightly modified to make it suitable for dis- 
cussing phase transitions in finite systems. As an example it is shown 
that the pendulum undergoes a second order phase transition when pass- 
ing from a vibrational to a rotating state. 

1 Introduction 

The Boltzmann-Gibbs formalism of statistical mechanics is heavily based on the 
equivalence of ensembles, which for many systems holds in the thermodynamic 
limit. It is not adequate to describe the thermodynamic behaviour of small 
systems. In particular, phase transitions can only occur in the thermodynamic 
limit of the canonical ensemble. Recently [21 ED HI OH E3 , the use of the 
microcanonical ensemble has been advocated to describe phase transitions in 
small systems. The present Letter supports this approach, but argues that 
one of its premises should be slightly modified. Indeed, it is tradition to use 
Boltzmann's entropy 

S B (E) =k B Heu(E)), (1) 

with e a small but fixed energy and with ui(E) the density of states, as the 
obvious definition of thermodynamic entropy of isolated systems. Alternatively 
(see [S] and the references cited there), the density of states ew(E) in can be 
replaced by the integrated density of states Q(E). The proposal of the present 
Letter is to replace it by a related quantity Q(E), solution of the non-linear 
differential equation 

Q'{Ef _ 1 = 1 _ u(EW(E) _ (2) 



e(E)Q"(E) lo'(E) 2 
The resulting entropy is denoted S@ (E) 

SejE) = k B \n(Q(E)). (3) 
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A conceptual argument supporting this modification is given below. Practical 
consequences for macroscopic systems are neglegible. But for small systems the 
consequences are important. 

2 Equipartition 

According to Boltzmann the equilibrium state of an isolated system is the 
macrostate that can be realized in the largest number of ways All ac- 
cessible states have the same probability. This can be taken as the definition of 
the microcanonical ensemble. The notion of entropy enters when two or more 
isolated systems are compared. The density of states in the combined system 
is the product of density of states of each of the composing systems. On the 
other hand, thermodynamic entropy must be the sum of the entropies of the 
subsystems. The standard argument is then that entropy necessarily is propor- 
tional to the logarithm of the density of states. This results in Boltzmann's 
entropy. Problem with this reasoning is that the compound system still consists 
of two unrelated systems, e.g. physically separated by a wall. Removal of this 
wall would affect entropy. If the wall is not removed then the compound sys- 
tem is in equilibrium, but this is the equilibrium of a microcanonical ensemble 
constraint to the requirement that the different subsystems, labeled with index 
j, have fixed energies Ej. Not all possible ways of distributing the total energy 
E = J^j Ej over the subsystems are realized. Hence it is not in equilibrium 
in the unconstraint ensemble. The usual way to overcome this problem is by 
means of equivalence of ensembles. However, this works only for macroscopic 
systems, if it works at all. Indeed, the essence of the microcanonical approach 
to phase transitions in finite systems is precisely that the equivalence of ensem- 
bles can break down in presence of phase transitions. When this happens then 
the microcanonical ensemble is the one that decribes nature, not the canonical 
ensemble. Several conclusions can be drawn from this discussion. In the first 
place it shows that the standard argument for associating Boltzmann's entropy 
with the microcanonical ensemble is not justified in case of small systems. It 
also shows that the possibility of phase separation should be taken into account 
because it modifies the accessible part of phase space. 

A different type of reasoning is now followed. It starts from the assumption 
that it is possible to compare isolated systems and that it is meaningful to state 
that they all have the same microcanonical temperature. Note that energy is the 
control parameter of the microcanonical ensemble, not temperature. Therefore 
the argument is restricted to simple systems for which energy and temperature 
are uniquely related. Initially, put all the isolated subsystems in their ground 
state. Next distribute small amounts of energy dE to the system in such a way 
that all degrees of freedom of the system are treated in the same manner. To 
this purpose, introduce an effective number of degrees of freedom rrij(Ej) which 
may depend on the energy Ej of subsystem j. Then the amount of energy 
received by subsystem j is proportional to nij (Ej ) . Let us postulate that this 
procedure of distributing energy over the subsystems keeps them all at the same 
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temperature T — T(E). For each of them is then 

C ^W = C ^T^W) (4) 

with C(E) the heat capacity of the total system. The obvious solution of this 
equation is 

C j {E j ) = k B m{E j ). (5) 
Integration of l/Cj(Ej) then gives temperature T as a function of energy Ej. 



3 Modelling heat capacity 



Let us next try to relate the effective number of degrees of freedom m(E) to the 
density of states u>{E). A suitable definition is 

m'(E) 2 
uj'{E) 2 - lu{E)uj"(E)' 
For a system with Hamiltonian H the density of states equals 



™(E) = 1+ ."^L.,,^ (6) 



u{E)= / dr/S{E-H{i)). (7) 



r 

In case of the harmonic oscillator is ui'(E) = 0, which makes (jHJl badly defined. 
However, if w(E) = AE V , with A constant, then m(E) = l + v follows. Hence, 
taking the limit v = one concludes that for a constant density of states one 
has m(E) = 1, as expected. This implies E = k^T, which is the canonical 
result. In case of the ideal gas is w(E) ~ £ , 3n/2-i^ implies m(E) = in/2 

and hence E = (in/2)k^,T which is again the canonical result. One concludes 
that © gives physical results in both cases. 
Note that one has 

m{E) - l ~k^m- (8) 

If the system is macroscopic then the constant 1 in this expression may be 
omitted, in which case integration can be done easily. The result is that in 
that case Boltzmann's entropy is the thermodynamic entropy, satisfying the 
thermodynamic relation 

- - (9) 
T dE V ' 

In the general case Boltzmann's entropy is not the thermodynamic entropy. The 

proposal is to replace it by Sq(E) with Q(E) chosen in such a way that 10 is 

satisfied and that the heat capacity C(E) equals k^m{E), with m(E) given by 

J5J|. This implies that Q(E) must satisfy 

1 -i-g. do) 



m{E) (Q'(E)) 2 



In combination with © this gives J2J). 
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4 Discussion 



Let us investigate some properties of Sq(E). A short calculation yields 



Hence the condition for S&(E) to be concave is that m(E) > 0. On the other 
hand, it is clear from © that the condition for Boltzmann's entropy to be con- 
cave is m(E) > 1. One concludes that some of the systems that are unstable 
w.r.t. Boltzmann's entropy are still stable when analysed with S@(E). In par- 
ticular, negative heat capacities, often discussed in the context of finite systems 
[iniiniinillSHIlini, are less likely to be negative when using S&(E). 

Of practical importance is that @ can be solved in a systematic manner. 
Introduce a function 

f (F\-k d 1 -1 Mo) 

Mm - ^Jes^e) - 1 - lsJey (12) 

The function fs(E) is defined in a similar way. Then J5J can be written as 

, _d l_ . , , ME) w(E)u"{E)-lj'{E? 

B dES' e {E) J0{ ' ME) + l lu{E)lu"{E)-2lj'{E) 2 ' 1 ' 

By integration of /e (E) one obtains the inverse of S' e (E) . Inverting and inte- 
grating again one obtains S%{E). 

Finally, note that the two entropies Sb(E) and Sq(E) coincide only when 
the density of states is an exponential function uo{E) = Aexp(bE). In that case 
the effective number of degrees of freedom is infinite. 



5 Constant heat capacity 

Of interest is the situation where m{E) is constant. E.g, if w(E) = AE V , then 
one has m(E) = 1/(1 — v). This case includes the harmonic oscillator as well as 
the ideal gas. However, there is a larger class of systems with constant m(E). 
Note that from (JSJ follows 

uj(E)uo"{E) 



oj'(E) 2 



= 1 7 = <?• ( 14 ) 



Solutions of this equation are of the form u)(E) = Aexp q (bE), involving the 
deformed exponential functions |161 IT7| 

exp q (x) = [1 + (1 - q)x] 1 l {1 - q) (15) 

(the notation [x]+ = max{0, x} is used). The corresponding O-entropy (deter- 
mined up to a constant term which is fixed by choosing an arbitrary positive 
energy e) is 

S e {E) = k B m\n E ~ Eg . (16) 
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Here, E g is the ground state energy of the system. Temperature T, calculated 
using (JHJ, satisfies 

kB T=^l. (17) 
m 

One concludes that any microcanonical system described by a density of states 
of the form ui(E) = Aexp q (bE) satisfies the equipartition law. 



6 The pendulum 

An interesting example of a finite system with phase transition is the pendulum 
with Hamiltonian 

H=j- iP 2 -a 2 Ico S (<f>). (18) 

For low energy —a 2 / < E < a 2 I the motion is oscillatory. At large energy 
E > a 2 1 it rotates in one of the two possible directions. A correct understanding 
of the thermostatistics of this model is highly relevant because rotational motion 
of ions and molecules, or part of molecules, occurs frequently in all states of 
matter. See e.g. |T5] . 

The density of states co(E) can be written as 

u(E) = —Lu Q (E/a 2 I). (19) 
ea 

with e a constant, inserted for dimensional reasons, and with u>q(u) given by 

1 f 1 1 1 1 

uj (u) = — dx —=—= — if — 1 < u < 1, 

27Tj y/X VI - X 1 - U + (1 + U)X 

If 1 1 1 

= — / d.T - if Ku. (20) 

See fig. ^ Note that a factor 1/2 has been inserted in case u > 1 to take into 
account that the pendulum is rotating either clockwise or anti-clockwise. 

The density of states oj(E) diverges at E = a 2 I. It is log-convex on both 
intervals —a 2 I < E < a 2 I and a 2 I < E, rather than log-concave. Hence, 
Boltzmann's entropy cannot be used to analyse this model. The effective number 
of degrees of freedom m(E) has the value 1/2 at large values of E, as expected. 
However, it does not start with the value 1 at E = —a 2 I, but with m(E) ~ 0.72. 
This is due to anharmonicity of the oscillatory motion. The heat capacity 
C(E) = k^m{E) has a shape typical for a second order phase transition at 
E = a 2 1. See fig. El 
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Figure 1: Density of states too(u) of the pendulum as a function of energy in 
reduced units. 




Figure 2: Number of degrees of freedom m(u) of the pendulum as a function of 
energy in reduced units. 
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7 Conclusions 



Arguments have been given why Boltzmann's entropy is not suited to discuss 
phase transitions in small systems and should be slightly modified. The pro- 
posed replacement is given by ©. It involves a function Q(E), related to the 
density of states u>{E) and obtained by solving J3J). It is based on the notion 
of effective number of degrees of freedom m(E) and the principle that, if two 
systems with equal m(E) are heated up in the same manner, then they have at 
all times the same temperature. Crucial point is relation JfjJ) between m(E) and 
the density of states ui(E). Omitting the constant term '+1' in this expression 
leads to Boltzmann's entropy. Hence, if the number of degrees of freedom is 
macroscopic then the proposed entropy @ coincides with Boltzmann's entropy. 
But for small systems one can expect important differences. 

To illustrate this point the classical pendulum has been discussed. In the 
present approach it exhibits a second order phase transition between vibrations 
and rotations. It cannot be treated using Boltzmann's entropy because the 
density of states is piecewise convex instead of concave. In the approach of 
8 it undergoes a first order transition because heat capacity is negative in 
a range of energies (this calculation has not been included but can be done 
straightforwardly) . Negative heat capacities have been discussed at many places 
in the literature, in both theoretical and experimental papers. It is out of scope 
of the present Letter to reanalyse all those applications. But it is clear that this 
has to be done. 

The main omission of the present Letter is a discussion of the quantum 
mechanical microcanonical ensemble. In the quantum case the density of states 
g(E) counts the number of eigenstates with energy in the range from E to 
E + e, for some fixed e > 0. It is a highly singular function of energy E. This 
complicates the calculation of the function Q(E), and hence, of the modified 
Boltzmann entropy S&(E). The only obvious solution to this problem is to 
replace the density of states by a continuous function. This is of course only 
meaningful when the eigenvalues of the Hamiltonian are densely spread over 
some relevant interval of energies. A more fundamental solution is lacking and 
requires further investigation. 

Acknowledgments I thank Prof. D.H.E. Gross for discussions which helped 
to clarify the text. Maple 9.5 has been used to produce the drawings. 
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